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Abstract — The focus is on noise-free half -duplex line networks 
with two sources where the first node and either the second 
node or the second-last node in the cascade act as sources. In 
both cases, we establish the capacity region of rates at which 
both sources can transmit independent information to a common 
sink. The achievability scheme presented for the first case is 
constructive while the achievability scheme for the second case 
is based on a random coding argument. 

I. Introduction 

Most wireless networks are half-duplex constrained, i.e. the 
network nodes cannot transmit and receive simultaneously. 
In order to handle the half-duplex constraint, transmission 
protocols deterministically split the time of each network 
node into transmission and reception periods. This approach 
is easy to realize since nodes do not have to change rapidly 
between their transmission and reception modes. However, the 
approach is suboptimal from an information theoretic point 
of view. It does not take into account that the throughput 
of each half-duplex node can be increased by allowing it to 
choose the transmission-reception patterns in dependence of 
the information to be sent. 

This observation goes back to fl] that introduced a binary, 
deterministic channel model for half-duplex constrained relays 
and demonstrated, using the example of a three node line 
network, that larger rates as compared to time-sharing are 
possible by modulating the operation modes of the relay 
based on the underlying information |2]. In 131, the capacity 
of the degraded half-duplex relay channel was derived. The 
authors also noted that the schedule of the relay has to carry 
information in order to achieve the capacity. 

An extension of this result to line networks with multiple 
sources was presented in [4] and [5]. In what follows, we 
refer to the intermediate nodes, i.e., the second to second- 
last nodes in the cascade, as relays since they must relay the 
first node's message to the last node that is the destination 
for all messages. Within the setup of |5| a source and a 
subset of the relays deliver independent information to the 
destination under the assumption that adjacent node pairs are 
connected by noise-free {q + l)-ary pipes. A coding scheme 
based on timing was proposed, and based on the asymptotic 
behavior of the coding scheme, the capacity of deterministic 
relay cascades of arbitrary length and a single source was 



established. If the cascade includes a certain number of relays 
with their own information, the coding scheme achieves the 
cut-set bound provided that the rates of the relay sources fall 
below individual thresholds. 

In the present paper, we treat deterministic half-duplex line 
networks with two sources where either the first or the last 
relay in the cascade is the second source. In both cases, we 
establish the capacity region of rates at which both sources 
can transmit independent information to a common sink. 

If the first relay acts as a source, it is shown that the capacity 
region is the cut-set region. This improves a result derived in 
|5 1 which says that the cut-set bound is achievable if the rate 
of the relay source falls below a certain threshold. In order 
to understand the new step in the achievability scheme, we 
briefly describe the scheme in |5|. Therein, the source node 
encodes its information by means of transmission symbols and 
idle symbols. An idle symbol indicates a channel use without 
transmission. The relays encode received information with the 
transmission pattern and with the value of the transmission 
symbols. Based on this, codes can be constructed which allow 
the nodes to cooperate in a sense that each node controls the 
transmission pattern applied by the next node. Hence, new 
information injected by the relay source is not allowed to be 
represented by the transmission pattern since, otherwise, the 
previous node is not able to control the applied transmission 
pattern. This is, in fact, the reason why the rate of the relay 
sources cannot exceed a certain threshold. In the new scheme, 
the relays still use the original idea. However, the source 
regards its Unk to the relay source as an erasure channel where 
the erasures are a consequence of the half-duplex constraint. 
Hence, the source and the relay source do not cooperate 
anymore which enables the relay source to represent own 
information with transmission patterns. It turns out that this 
new step is necessary to achieve all points in the cut-set region. 

In the second part of this paper, we focus on the case where 
the last relay in the cascade acts as a source. The capacity 
region is derived by means of a random coding argument. 

II. Network Model 

Consider a discrete memoryless relay cascade as depicted 
in Fig. [T] Each node is labeled by a distinct number from 
V — {0, . . . , m} with TO > 0. The integers and m refer to 
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Fig. 1. A noiseless relay cascade with two sources. The link model is 
illustrated by means of feedback. If relay 1 is transmitting, the switch is in 
position 1 otherwise in position 2. 

the source and sink, respectively, while all remaining integers 
1 to m — 1 represent half-duplex constrained relays, i. e. 
relays which cannot transmit and receive at the same time. 
The connectivity within the network is described by the set of 
edges 8 — {(fc, fc + 1) : < fc < m — 1}, i.e. the ordered pair 
(fc, fe + 1) represents the communications link from node k to 
node fc + 1. The output of the fcth node, which is the input to 
channel (/c, fc + 1) is denoted as Xk and takes values on the 
alphabet Xk = Qk U {N} where Qk denotes the transmission 
alphabet of node fc while the idle symbol "N" signifies a 
channel use in which node fc is not transmitting. The input 
of the fcth node, which is the output of channel (fc — 1, fc) is 
denoted as Yk and is given by 



Xk- 
Xk, 



if Xk = N 
if Xk e Qk 



(1) 

(2) 



where 1 < fc < m — 1. Channel model ([T]) captures the 
half-duplex constraint as follows. Assume relay fc is in its 
transmission mode, i.e. Xk G Qk- Then relay fc hears itself 
(Xk — Xk) but cannot listen to relay fc — 1 or, equivalently, 
relay k and relay fc — 1 are disconnected. However, if relay fc is 
not transmitting, i. e. Xk = N, it is able to listen to relay fc — 1 
via a noise-free jAfc-ij-ary pipe (Yfe = Xk-i). Another 
interpretation of the channel model is that the output Xk of 
each relay fc controls the position of a switch which is placed 
at its input. If relay fc is transmitting, the switch is in position 1 
otherwise it is in position 2 (see Fig. [T]l. Since a pair of nodes is 
either perfectly connected or disconnected, we obtain a deter- 
ministic network with p{yi, ym\xo, Xm-i) e {0, 1}. 

At the beginning of a new block 6 of n channel uses, source 
node and relay fc 6 {l,m— 1} produce a uniformly and inde- 
pendently drawn message Wo,6 £ {l, . . . , 2"-'^"} and Wk.b G 
{l, . . . , 2"^'' }, respectively. Based on the received sequence 
in block b, sink node in forms the estimates Wo^i,-(m-i) and 
Wk,b-(m-i~k) ofWo^b-(m-i) and Wk^b-(,n-i-k)- We assume 
the following encoding functions 



•^ki 
Xli 



h^{Wk,Yl-^) 



(3) 

k > (4) 

VZ7^{0,fc,m}. (5) 



The first subscript describes the node number while the second 
subscript i corresponds to the time instance where 1 <i < n. 



,Ykl-i}. 



Moreover, is used as short hand notation for the set 

{Yki, 



III. The First Relay IS A Source 

Theorem 1: The capacity region C of the line network of 
Fig. [T] where node and relay node 1 are sources, is 

r Ro<H{Y^\X^) ] 

C^[}{ Ro+Rl<H{Yrn) \. (6) 

[ Rq + Ri < mm2<i<,n-i H{Yi\Xi) J 
The union is over all probability distributions of the form 

Pxo{-)PxA-)Px,\xA-)Px,\x,{-) • • •^x„_,|x„_.(-)- (7) 

Proof: We start with the achievability of C. At the end of 
block 6—1, node and relay node 1 choose new messages wo,b 
and wi^b, respectively, which are sent in block b by means of 
the sequences ^Q(wo,f)) and x^{wo,b^i,wi,b)- The remaining 
relays i, 2 < i < m—1, forward older messages. In particular, 
relay i sends Xi{wo,b-i,'Wi^b-(i-i)) in block b. 
Coding: 

• At node m — 1 f5\: Node to — 1 represents in- 
formation by taking Um-i < n transmission sym- 
bols per block of length n from the alphabet Qm-i 
and by allocating the n„i-i symbols to the trans- 
mission block. Thus, |Qm-i|""'"^ („ " J different se- 
quences ^„i_i (wo,6-(m-i), wi,{,_(„_2)) ai-e available 
at relay m — 1. Observe that |Qm-i|"""^ equals the 
number of possible distinct sequences when the |Qm-i|- 
ary symbols are located at fixed slots while („ " J equals 
the number of possible transmission-listen patterns. 

« At node i, 1 < i < m- 2 |5|: For each transmission-listen 
pattern used by node i + node i generates a codebook. 
For a particular pattern, node i allocates rii transmission 
symbols from the alphabet Qi in all possible ways to 
the n — Tii+i listen slots of the pattern. The slots of the 
pattern, in which node i + 1 transmits, are filled with idle 
symbols "N". This procedure generates a certain number 
of transmission-listen patterns used by node i. 

• Due to the above codebook construction, adjacent nodes 
can cooperate since each node z > 1 knows the messages 
to be forwarded by the next node and, thus, is aware of 
the applied codeword. The construction guarantees that 
adjacent nodes i and i + 1, i > 1, do not transmit at the 
same time. 

• At node 0: In contrast to |5|, node does not adapt to 
the transmission-listen patterns used by node 1. Instead it 
uses an optimal point to point erasure channel code with 
alphabet Xq for encoding VFo.b. Output symbols Yi of 
link (0, 1) are erased with a probability of 1 — pxi(N), 
i.e. the erasure probability is equal to the fraction of time 
in which node 1 transmits. It should be noted that node 
transmits a part of the information in the timing of the 
transmission symbols since the erasure code makes use 
of symbol "N". 



Achievable Rates: The capacity of a |Ao|-ary erasure chan- 
nel with erasure probabiUty 1— pxi (N) equals px^ (N) log \ Xq\ 
achieved by a uniform input distribution over Xq. Due to the 
channel model, we clearly have 



H(Yi\Xi) = 

< 



H{X„\Xi=N) 
px, (N)log|A'o 



(8) 



with equality if PXa\Xi{'\N) is the uniform distribution over 
\Xo\- Thus, an optimal erasure channel code for the link (0, 1) 
satisfies Rq — H{Yi\Xi) — e with e ^ as n — > cxo. 

Further, we know from the results derived in IS] Sec. III.A] 
that 



as n 



(9) 



ni ) 

for < i < ni — 2. For i = m — 1, the exponent in 
^ becomes H{Ym) (with n„i — 0). Hence, Ra + Ri < 
niin2<i<™-i HiYi\X,) and Rq + Ri < H{Y„,). 

The converse is immediate since the bounds of ^ corre- 
spond to the cut-set upper bound fS' Sec. IV]. (|7|i follows from 
the following consideration. Again, due to the channel model 



H{Y,\X,)^pxAN)H{X,^i\X, = N), 



(10) 



so that H{Yi\Xi) is a function of pXi-iXi{') for all 2 < i < 
TO — 1. Hence, without restriction we may assume the Markov 
chain Xi — ■ ■ ■ — X^-i- Further, we can choose a uniform 
PXo\Xi{'\^) over \Xo\ since this achieves the upper bound ([8]). 
Clearly, such a distribution also exists when Xq is independent 

of Xi, . . . , Xm-l- ■ 

Remark 1: Theorem[T]shows that the capacity region of the 
considered line network is equal to the cut-set region. This 
improves a result in (5] which says that the cut-set bound 
is achieved when the rate of the relay source falls below a 
certain threshold. The new ingredient here is that the relay 
source is allowed to encode its own information in the timing 
of transmission symbols. In fact, node accepts that a part 
of its information is erased by node 1. We point out that this 
approach, namely to treat the link to the relay source k as an 
erasure channel, is not cut-set bound achieving if fc > 2. 

Example 1: We apply Theorem [T] to a line network com- 
posed of three nodes where the first two nodes have their 
own information. The alphabets are Xq — Xi — {0,1, N}. 
This example has already appeared in ID, 15] . However, we 
are now able to characterize the complete capacity region. 
Moreover, the approach here is easier since we can restrict 
attention to independent Xq and Xi. By choosing Pxoi') to 
be the uniform distribution and, further, by assigning the same 
probability masses to Xi = and Xi = 1 (due to symmetry), 
we obtain the following expression for the capacity region 



i?o + i?i < (1 - Px, (N)) log 2 + h{px, (N)) 



(11) 



The union is over px^ (N) and h{-) denotes the binary entropy 
function. C is depicted in Fig. |2] Note that the region bounded 
by the dashed line contains the rates which are achievable 
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Fig. 2. Capacity region jilt is given by the solid curve. The time-sharing 
region is bounded by the dashed line. 



when the time of the relay is deterministically split into 
transmission and reception periods. In order to obtain this 
region, time-sharing between {Ro,Ri) = (0.51og2 3, 0) and 
(0, log2 3) bits per use has to be performed. 

IV. The Last Relay is a Source 
In the remainder, we will make use of the following notation 

WO,b-li+j;i+k] — i^^Cb-Ci+j)! • • • j'"^0,b-(i+fc)/ 
X[l.t] — {Xu...,Xt}. 

Lemma 1: [6, Th. 14.2.3] Let a'"'' denote the typical set 
for the probability mass function p{xi, . . . , x„) and let 

n 

P{Kl =X^,---,Kn =^n) = Y[p{xil\x3l,---,Xnl) 

1 = 1 



P{X21\X31, ■ • ■ , Xnl)p{x3l, ■ ■ ■,Xnl)- 



Then 



Theorem 2: The capacity region C of the line network of 
Fig. [T] where node and relay node to — 1 are sources, is 



i?o < mini<,;<,„_i H {Yi\Xi 
C^[}{ Rm-i < H{Y^\U) 

Ro + Rm-l < H{Yrn) 



(12) 



The union is over all probability distributions of the form 

PxoPxiPx2\XiPx3\X2 ■ ■ • ^x„_2|x„_3-Pc/|x„_2^x„_i|;7- 

(13) 

Remark 2: C is equal to the cut-set region if there exists 
a probability distribution for each boundary point such that 
Xm-i is independent of U . Otherwise, C is smaller than the 
cut-set region. 



V. Proof Outline of Theorem |2] 
A. Achievability 

Random codebook generation: 

. Split Wq into B sub-blocks Wo,b, b = 1,2, . . . ,B, that 
each take on 2"^" values. Similarly, split Wm-i into B 
sub-blocks Wm-i.b, b = 1,2, . . . , B, that each take on 
2ni?„-i values. 

• Node m — 1 generates at random 2"^'' independent 
sequences of length n, m (wo,h-(m-i)), Wo,b-(m-i) £ 
{l,...,2"^o}, according to ]Xl^iP{ui). 

• Codebook at node to — 1: On each of the 
sequences u (wo.6-(m-i))' node to — 1 superposes 
a random codebook with 2"^""^^ codewords 

£m-l (w^O,b-(m-l),W'm-l,b) USing HLl ^(^^"i-l,' 1^0- 

• Codebook at node to — 2: For each u (wo,b-(m-i))> 
node TO — 2 generates 2"^" independent 
sequences x^_^ (wo,6-[m-2;m-i]) according to 

• Codebook at node < i < m — 2: For each 

(^o,6-[i+i;m-i]) ^ode I generates at random 2"^° 
independent sequences {wo,b~[i-m~i\) according to 
nr=iP(a;*,jk»+i,;)- 
Encoding: At the beginning of each block b, node i, < 
I < TO — 2, has the estimate^ WQ,b-i-i of ifo.b-i-;, I > 
0. To send the estimate wo.b-i, node i selects the codeword 

Xi (w)o,fc-[rm-l])- 

Similarly, at the beginning of block b, node 
TO - 1 has the estimates {u;o,fc-(m-i)-;, Wm-i,h-; } 
of {wo^6-(r„_i)_/, wo,h-;}, ; > 0. To send the pair 
{wo,b-(m-i) , Wm-i.b}, node TO — 1 selects the codeword 

(wo,b- ( ?7l — 1 ) ) 

Every node i, 1 < z < to, receives the sequence y . (b) in 
block b. 

Decoding: At the end of block 6, sink node to performs the 
following e-typicality check in order to determine i&o.b-(m-i) 
and w„i-i^b'- 

(6)} 

(14) 

By Lemma [T] it follows that the error probability of ( fT4] l is 
smaller than 

2-n{I{U,X^^i;Ym}~ee)^ ^^^^ 

Further, if the estimate u)o,b-(m-i) is known at the sink, the 
error probability regarding the estimate Wm-i,b is smaller than 



2-n(/(X™_i;y„|;7)-6e) 



(16) 



Similarly, at the end of block b, node i, 1 < i < to — 1, 
performs the following e-typicality check in order to determine 

'The source knows its own messages. However, for simplicity, we will also 
denote this message with a hat. The same is done for the relay source m — 1. 



Wo^b-i- 

[xi-i (wo,b-[i-l;m-l]) (wo,fc_[i;,„_i]) , V-ib)^ 

e A(")(x,_i,x„ro. (17) 

According to Lemma [T] the error probability of (fTTb regarding 
the estimate Wo,b-(i-i) is smaller than 

Now, by considering all possible error events we obtain from 
O, dB and (HI that 

{i?o < mini<i<„i_i H {Yi\Xi) ^ 
R,n-l<H{Y,n\U) \ (19) 

Ro+Rm-l<H{Yra) J 

is an achievable region. Observe that the exponents of the 
error probabilities can be simplified since Yi is a function of 

B. Converse 

Consider the following bounds, where Pb.o and Pb,m-i are 
the average bit error probabilities when decoding Wq and 
W,n-i at the destination node m. For 1 < Z < to — 1, we 
have 



ni?o(l-/j(n,o)) 

(a) 

< HWo;y;;,) 



(20) 

(21) 
(22) 



</(Wo;W^™-irr>C) 

71 

= ^/ (Wo;^/.^™!!^™-!!^'-^!^^) (23) 



^^Y.HWo;Yu\W^-iYr'Y:,-') 



id) 



=' J2 1 {Wo;Yu\W„,-iYr'Y:-'XI 



i=l 

if) " 

< Y,H{Yu\Xii) 

i=l 

^^nH {Yi\Xi,Q) 
(h) 

< nH{Yi\Xi) 



(24) 
(25) 
(26) 

(27) 

(28) 
(29) 



where 

• (a) follows by Fano's inequality 

• (b) follows from the chain rule for mutual information 
and from the independence of Wq and Wm^i 

• (c) follows by Markovity 

• (d) follows because X'l is a function of Yj'^^ for all 1 < 
^ < TO — 1 and ^m-i is a function of and Wm^i 

• (e) follows because Wq determines X'^^^ , . . . , Xl^}2 
what, in turn, determines Y^^^ , . . . , F^jla and Y^^2 

• (f) conditioning does not increase entropy 



• (g) follows by defining Q to be a time-sharing random 
variable with Yi Yig, Xi Xiq. 

• (h) conditioning does not increase entropy 
Further, we have the bounds 



nRm-lil - h{Pb,rn-l)) 

(a) 



n 
n 



(d) 



(e) 



(/) 



^ / (w„^-l;Y^^\W„Yl-^^X'-^ 

n 



[0;m-l] 



4=1 



(9) 



nH {Y^\U) 



(30) 
(31) 

(32) 
(33) 

(34) 

(35) 

(36) 

(37) 
(38) 



where 

• (a) follows by Fano's inequality 

• (b) follows from the chain rule for mutual information 
and from the independence of Wq and Wm-i 

ri-l 



(c) follows because Y^-^ = Xt^ 



• (d) follows because W^g determines Yl ^, . . . , Y!^^\ 

• (e) follows because Wq and Wm-i determine Y„i,i 

. (f) follows by defining = {X'-\,Y^_}j) and from 
the fact that conditioning does not increase entropy 

• (g) follows by defining Q to be a time-sharing random 
variable with U := {Vq, Q) and F,,, := Y„iq. 

Concerning the sum-rate, we obtain 

nRo{l - h{Pbfl)) + nR,n-i{l - h{Pb,n-i)) (39) 

(a) 



< i{w^-y::)+i{w^^,-y::) 

< /(Wo; r,;:) + /(w^™-i; w^y;:^) 
'^^ i{WoW„,^,-y:,) 

n 

= Y,I{WoWm-l:Yrm\Yi^^) 

(c) " 
i=l 

^^nH{Yra\Q) 

< nH{Ym). 

where 

• (a) follows by Fano's inequality 



(40) 
(41) 
(42) 

(43) 

(44) 

(45) 
(46) 



> (b) follows from the independence of Wq and Wm~i 

m (c) follows since Wq and Wm-i determine Y^.i and from 
the fact that conditioning does not increase entropy 

> (d) follows by defining Q to be a time-sharing random 
variable and Y,n ■= Y^q 

• (e) conditioning does not increase entropy. 

It remains to check ( fT3] l. Observe that X„i-i.i is a func- 



tion of Yr-_\ and W2. Since 



Oil 



,x 



m — 2,i 



pend on W2, we have the Markov chain Xoi, . 
^m-i^m-\ - Hence, we have 



P(m,Xo, ...yXr,, 

= P{u)P{xo, . 

= P{u)P{xo^,. 



■ : '^m— 1 1 ^) 



■ 7 Xm-2,i\'i', Xj^_i, 2/„i_i) 



P{Xm-l,i\h a^„i-l7 Vm-l) 



= P{u)P{xo, . 
which shows that 



. ,X,n-2\u)P{Xm^l\u) 



Xn 



, x„i^2 — u — x„ 



do not de- 

■ , Xm~2,i — 

(47) 
(48) 
(49) 

(50) 
(51) 



Finally, by the explanations in the last section of the proof of 
Theorem [1] we have the Markov chain 



Xi 



Xm-?_ 



U — Xm-1 



(52) 



and the independence of from Xi, . . . , Xm-l^ U . ■ 

VI. Discussion 

An obvious extension is to allow any relay in the cascade to 
act as second source. However, the solution for this case turns 
out to be elusive. Though developing achievable rate regions 
using superposition random coding is straightforward, proving 
a converse seems to be more difficult. An intuitive explanation 
is that having the second source located at the first or the last 
link offers greater freedom for choosing a coding strategy as 
compared to the other links. This is related to the fact that the 
first source does not receive information while the sink node 
does not send information and, therefore, both nodes are not 
affected by the half-duplex constraint. One could also think of 
extending the erasure coding technique outlined in the proof 
of Theorem[T] In particular, if all nodes before the relay source 
use independent erasure codes, the relay source would be able 
to send own information in the timing of transmission symbols. 
However, it can be shown that this approach does not achieve 
the cut-set bound and, therefore, a converse is missing again. 
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